SPONTANEOUS ADVERSE EVENTS REPORTING 



BACKGROUND OF THE INVENTION 

National health authorities and governmental 
5 regulatory Agencies in major countries require 

Pharmaceutical Manufacturers to collect and report Adverse 
Drug Reactions, Adverse Events, Product Complaints and 
Device Failure Complaints, and to provide Full Disclosure 
about the side effects, risks and contraindications 

10 associated with their products. Reports of Adverse Events 
are received by pharmaceutical manufacturers via letter, 
fax, e-mail or telephone and are usually processed by 
safety professionals. The process consists of a series of 
sequential and/or concurrent sub-processes: Intake, 

15 Investigation and Follow-up, Analysis and Reporting. The 
Adverse Event is usually received as a report (Narrative 
Verbatim) and is then processed by a healthcare 
professional, entered into a database system, catalogued 
and linked to a dictionary of international standard 

20 medical terminology such as the terms found in MedDRA, the 
Medical and Drug Regulatory Affairs Code, or other 
nationally or internationally recognized coding schema such 
as World Health Organization's Adverse Reactions 
Terminology (WHO -ART) Dictionary, or the U.S. Food and Drug 
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Administration's (FDA) Coding Symbols for Thesaurus of 
Adverse Reaction Terms (COSTART) schema, either by hand or 
assisted by a semi -automated processes, called auto- 
encoding . 

5 The investigation and follow-up sub-processes aim at 

having the event verified and validated by a healthcare 
professional (physician, hospital) . A judgment is reached, 
whether the Adverse Event report is serious (according to 
existing definitions established by a national health 

10 authority or drug regulatory agency) and unknown, 

(unlabeled) in which case a report has to be filed with the 
health authorities within a short period (usually 15 days) . 
All other cases are regularly analyzed and reported on an 
annual or semi-annual basis in accordance with the laws, 

15 regulations or guidelines set forth by a national health 
authority or drug regulatory agency. 

In cases where the Adverse Event occurred in a foreign 
country or was received by a license taker of the 
manufacturer, the reports are transferred between 

20 manufacturer's safety organizations, requiring rapid 
information transfer and rigorous quality assurance 
measures. Special measures have to be taken in cases where 
reports or data get translated from one language to 
another. The aim of the reporting process is to discover 
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previously unknown Adverse Drug Reactions, Drug-Drug 
Interactions, Drug-Food Interactions or other safety issues 
at an early stage. 

The use of standardized terminology is intended to 
5 bring uniformity to the reporting for a large international 
user base with varied linguistic and cultural differences 
in reporting Adverse Events and Product Complaints. It is 
intended as a pragmatic, clinically validated compendium of 
medical terminology with an emphasis on ease-of-use of data 

10 entry, retrieval, analysis and display, with a suitable 
balance between sensitivity and specificity, within the 
regulatory environment. A standardized dictionary, such as 
for example MedDRA is applicable to all phases of 
development for a drug product and the period during which 

15 a drug product is sold, and is also applicable to the 

product life cycle of most medical devices. By providing 
one standard of medical terminology, the effectiveness and 
transparency of medical product regulation worldwide is 
improved. Standardized terminology for reporting Adverse 

20 Events or Product Complaints is grouped in three main 
associations : 

• Equivalence: synonymous terms are grouped together. 
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• Hierarchical: provides vertical links between super- 
ordinate (broad grouping terms) and subordinate 
descriptors 

• Associative: allows terms, which are neither 

5 equivalent nor hierarchically related but may be 

related by sign, symptom, body system or organ class, 
disease and/or diagnosis to be linked horizontally 
(Special Search Categories) . 

A standardized dictionary can contain many terms. For 
10 example, in the current version of MedDRA at each level is 
has approximately the following number of terms: 

• System Organ Class (SOC) - 26 

• High Level Group Term (HLGT) - 334 

• High Level Term (HLT) - 1,663 

15 • Preferred Term (PT) - approximately 11,000; 

International Level of Communication 

• Lowest Level Term (LLT) - approximately 46,000; 
Synonyms 

The use of multiple standardized terminologies however 
20 in reporting and codifying Adverse Events poses challenges 
and creates coding requirements with respect to accurately 
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assessing information collected vis-a-vis a single Adverse 
Drug Reaction or Adverse Event case, or trending 
information collected across multiple cases albeit for a 
single drug product or even for similar but not identical 
5 drug products that produce the same desired therapeutic 
effect through similar mechanisms of action within the 
human body. Because of the large number of terms , there 
are sometimes too many choices to describe a particular 
Adverse Event or device complaint. In addition, there are 
O 10 problems due to the fact that each reported event requires 
SB a written verbatim narrative of the event, which requires 

that the safety professional be well versed in the 
'zZ standardized formats and terminologies employed to catalog 

q and characterize various Adverse Events and Product 

|^ 15 Complaints. Selection of the proper term and creating a 
0 highly standardized and structured format applied to each 
verbatim report are difficult and time-consuming processes 
requiring great care. 

20 What is desired therefore is a system and method for 

assisting and rigorously structuring in the intake, 
investigation and Follow-up, Analysis and Reporting of all 
Adverse Events and Product Complaints, but especially 
spontaneously reported cases . 
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It is also desired to provide a system and method for 
standardizing Adverse Event and Product Complaint 
reporting. In that way an untrained health professional or 
a company employee assigned to receive, process and record 
5 Adverse Event reports or can receive and record event 

reports without the need for intensive training in safety, 
safety data and information collection, applying and 
utilizing various coding schema, or applying and utilizing 
requisite clinical safety knowledge. In addition, with 
Q 10 such a system, a patient can, in a highly effective, 
IB efficient and standardized manner, report meaningful safety 

^ data and information directly to an interested party such 
35 as his / her treating physician or a manufacturer of a drug 
'Uj product . 

M- 15 It is also desired to provide a system and method to 

Q efficiently generate Adverse Event and Product Complaint 

reports in order to comply with event reporting time 

deadlines . 

It is also desired to provide a system and method to 
20 efficiently, safely and seamlessly transfer the collected 
data into any standard industry drug safety system, using 
industry standard protocols and definitions like the E2B 
and E2C standards defined by the International Conference 
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on Harmonization of Technical Requirements for Registration 
of Pharmaceuticals for Human Use. (ICH Ml-3) . 

It is also desired to provide a system and method to 
collect and manage data utilizing a network computer system 
5 operating in a stateless environment, while having the 
ability to maintain and manage state. 

SUMMARY OF THE INVENTION 

10 The present invention overcomes the drawbacks of the 

prior art by providing in a first aspect a method of 
dynamically managing and structuring the input and 
improving the reliability, accuracy and quality of 
collected information by presenting the user with a 

15 hierarchically structured set of predefined terms, 

receiving reported information from a user corresponding to 
at least one of the predefined terms, categorizing and 
characterizing the reported information, dynamically 
converting the reported information into a standardized 

20 output and storing the standardized output. 

BRIEF DESCRIPTION OF THE DRAWINGS 
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These and other objects and advantages of the 
invention will become more apparent from the following 
detailed description of a preferred embodiment of the 
invention when taken into conjunction with the drawings 
5 wherein: 

Figure 1 is an exemplary computer system for 
implementing the present invention. 

Figure 2 is an exemplary computer network system for 
implementing the present invention. 
10 Figure 3 is a flow chart depicting an exemplary site 

flow diagram for the present invention. 

Figure 3a is a flow chart depicting a detailed 
exemplary site flow diagram for the present invention. 

Figure 3b is a flow chart depicting a detailed 
15 exemplary site flow diagram fob: the present invention. 

Figure 3c is a flow chart depicting a detailed 
exemplary site flow diagram for the present invention. 

Figure 3d is a flow chart depicting a detailed 
exemplary site flow diagram for the present invention. 
20 Figure 3e is a flow chart depicting a detailed 

exemplary site flow diagram for the present invention. 

Figure 3f is a flow chart depicting a detailed 
exemplary site flow diagram for the present invention. 
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Figure 3g is a flow chart depicting a detailed 
exemplary site flow diagram for the present invention. 

Figure 3h is a flow chart depicting a detailed 
exemplary site flow diagram for the present invention. 
5 Figure 3i is a flow chart depicting a detailed 

exemplary site flow diagram for the present invention. 

Figure 3j is a flow chart depicting a detailed 
exemplary site flow diagram for the present invention. 

Figure 3k is a flow chart depicting a detailed 
10 exemplary site flow diagram for the present invention. 

Figure 4 is a depiction of an exemplary version of a 
"Registration" page 

Figure 5 is a depiction of an exemplary version of a 
user login page for the interface of the current invention. 
15 Figure 6 depicts an exemplary physician patient 

consent page . 

Figure 7 depicts an exemplary Instructions page for 
the interface of the present invention. 

Figure 8 is a depiction of an exemplary depiction of a 
20 user identification page. 

Figure 9 is a depiction of an exemplary report 
designation page. 

Figure 10a is a depiction of an exemplary Adverse 
Event reporting page. 
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Figure 10b is a depiction of an exemplary Adverse 
Event reporting page. 

Figure 10c is a depiction of an exemplary Adverse 
Event reporting page. 
5 Figure lOd is a depiction of an exemplary non-English 

language Adverse Event reporting page. 

Figure 11 is a depiction of an exemplary medication 
reporting page. 

Figure 12 is a depiction of an exemplary suspect 
10 medication reporting page. 

Figure 13 is a depiction of an exemplary medication 
supplement -reporting page. 

Figure 14 is a depiction of an exemplary medical 
condition-reporting page. 
15 Figure 14a is a depiction of an exemplary laboratory 

test reporting page. 

Figure 15 is a depiction of an exemplary written 
narrative report. 

Figure 16 is a depiction of an exemplary summary 
20 report . 

Figure 17 is a depiction of a data flow diagram of the 
present invention . 

Figure 18 is a flow chart depicting the data flow 
steps of the present invention. 
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DETAILED DESCRIPTION OF THE PREFFERED EMBODIMENT 



5 TABLE OF CONTENTS 

I. Introduction 

II. User Interface 

III. Database Terminology Standardization 

IV. Database Encoding 
10 V. Embodiments 

I. Introduction 

The present invention will now be described in detail 
with reference to the accompanying drawings. While the 

15 present invention is described in the context of an 

Internet based communications network, which includes a 
specific number and type of components, the system of the 
present invention may be incorporated into data and voice 
communications networks of many structures and sizes. The 

20 drawings are intended to provide one example of a 

communication network configuration in which a system of 
the present invention may be implemented and are not 
intended to limit the applicability of the present 
invention to other network configurations. For example, all 
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of the features of the present invention could be 
implemented using a voice recognition system, wherein the 
user could access the system via a landline or wireless 
mobile communications device and enter information via 
5 responses to auditory choices and menus, or to text prompts 
on a wireless pager. 

As will be disclosed below, an aspect of a 
preferred embodiment involves a process for entering, 
accessing and encoding data, in any language, through a 
g 10 super-secure portal for Spontaneous Adverse Events 
ffi Reporting, Medical Product and Device Complaint Reporting 

Medical Inquiries and registry functions. The Portal is 
:! 'tf accessed from a Web-Brows er via the WWW using strong 
q encryption and HTTPS as the sole protocol between browser 
1^ 15 and application. No active content is needed in the 

%S 'i 

Q browser to run the application. 

With reference to the various systems and 
methodologies of the present invention, as described below, 
aspects of the present invention are described in terms of 
20 steps, some of which being executed or executable on a 

computer system. Various implementations of the inventive 
systems and methodologies provide a comprehensive, multi- 
faceted; multi-user based incident reporting system and 
method. In accordance with these implementations, there is 
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provided a system and method for entering, accessing and 
encoding data through a super- secure portal for Spontaneous 
Adverse Events Reporting, Medical Product and Device 
Complaint Reporting and Medical Inquiries. In other 
5 aspects of the invention, which are discussed in much more 
detail below, the data encoding routine of the present 
invention presents a novel method to populate the database 
in order to provide high accuracy and data entry 
redundancy. 

10 In a preferred implementation, a central database is 

developed and contains information pertaining to Adverse 
Events Reporting, Medical Product and Device Complaint 
Reporting and Medical Inquiries and individual patient 
information, which preferably is incorporated into the 

15 database corresponding to each reported event or complaint. 
Other types of information can be incorporated, as will 
become apparent below. Preferably the data fields are named 
in accordance with the E2B and E2C standards issued by the 
international committee for harmonization (ICH Ml-3) . 

20 Through the use of the present invention, the process 

of developing the database incorporates techniques to 
ensure that the information reported is reliable and 
accurate. Accordingly, redundant data input systems and 
methods are incorporated to ensure the reliability and 
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accuracy of reported information through the various 
systems and methodologies of the invention. Information 
concerning the patients 7 condition, prescribed medication, 
Adverse Events and complaints are entered into the database 
5 through a user interface wherein the user selects 

information to be included in the database using pull down 
menus. In addition, once the data is selected, the user 
must confirm the reported information at least twice. Thus 
through the immediate review and detection of data input 
O 10 errors, corrective action can be undertaken immediately, by 
~ the incident user, therefore increasing the reliability and 
"I, 5 accuracy of the reported information. 
jz In accordance with one aspect of the invention, 

p patient information, medication information, Adverse Event 
hk 15 and Product Complaints are received from the user via the 
CI input interface. Data is input through the interface using 

either pull down menus or free form data entry fields. The 
pull down menus include a set of clickable data entries for 
each data categories. In the event that user is unable to 
20 locate the data entry from the provided pull down menus 
that accurately reflects the patients information or 
condition, then the user can enter that information in a 
data entry field. However, any data that is entered via 
the data entry field rather than chosen from a pull down 
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menu is automatically flagged for verification and 
validation . 

In accordance with one aspect of the invention, 
patient information is provided and can be accessed by a 
5 user or safety monitor through an exclusive password- 
protected system. In this way, a flexible and paperless 
reporting environment meets the demands of real-time secure 
and reliable information needs of patients, treating 
physicians, clinical investigators and safety monitors 
10 within product manufacturers and their licensees and 

partners. In other aspects, safety reports can be generated 
from the event reports for use in reporting significant 
events, or in transferring case reports to another database 
or data repository. 

15 

Computer System Overview 



Although a variety of different computer systems can 
be used with the present invention, an exemplary computer 
20 system is shown generally in Figure 1. 



Computer system includes a host computer having a 
processor 2 04, main memory 2 08, a secondary memory 210 
comprising a hard disk drive 212 and a removable storage 
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drive 214. The exemplary components of host computer are 
operably connected via an address/data bus 2 06, which is 
not specifically designated. Memory can, and preferably 
does include a volatile memory (e.g. random access memory), 
5 which is coupled with the data bus for storing information 
and instructions for processor, and a non-volatile memory 
(e.g. read only memory) coupled with the data bus for 
storing static information and instructions for processor. 
Data storage device can comprise a mass storage device. 

10 Host computer constitutes a hardware platform, which 
executes instructions to implement the application 
program (s) described below. It will be understood that 
system, as set forth in Figure 1, is a schematic 
representation only. Accordingly, the system as described 

15 above and below can be implemented as an integral stand 
alone system as suggested by Figure 1, or can include 
separate component parts which are interconnected and 
operable for implementing the invention described below. 
Interface device preferably comprises a multi-user 

20 network interface (e.g. an Internet interface) , which 

couples computer system to a multi-user system (e.g. the 
Internet in one embodiment of the present invention) . 
Interface is coupled to permit communication with various 
application programs contained on the hardware platform 
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defined by computer system. The Interface can typically be 
implemented using a graphical user interface (GUI) 
incorporating pull down menus and data entry fields. 

As mentioned above, and in a preferred implementation 
5 of the present invention, interface device comprises an 

Internet interface. The Internet is a well-known connection 
of worldwide computer systems that operate using a well- 
known Internet protocol. The Internet is one type of multi- 
user computer system. Other Internet applications (e.g. 

10 using specific protocols) operate on top of the Internet 

protocol. One such application is the well-known World Wide 
Web or "www" Internet application that operates using the 
hypertext transfer protocol or http. The "www" Internet 
application is a "demand system" in which user requests 

15 information from a site and the site transfers the 

information back to the user on-line. Also well known is 
the email Internet application which operates using the 
simple mail transport protocol or SMTP. The email Internet 
application is a "present system" in that an information 

20 transfer command originates from a sender site and 

information pursuant to that command is presented to the 
target email address. Another Internet application is the 
file transfer Internet application that operates using the 
file transfer protocol ftp. In one embodiment, the present 
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invention utilizes the www, email, and file transfer 
Internet applications as well as the Internet protocol. 
Other embodiments of the present invention can be 
implemented in other multi-user computer environments. For 
5 example, the present invention could be implemented with a 
dedicated multi-user system. 

Computer system supports a software configuration, 
which operates under control of a conventional operating 
system. The operating system permits various application 
D 10 processes to be executed. These include, for example, a 

communications application that permits data transfer with 
z: various remote terminals as will become apparent below. The 
IS software environment further includes a data management, 
p storage, and retrieval application that is utilized in 

y* 15 connection with data storage device. The data management, 
O storage, and retrieval application organizes and stores 
information, which will be described in greater detail 
below. This information is organized and stored within the 
environment of the operating system on one or more mass 
20 storage devices such as data storage device. Other 

applications conventionally known may be included in the 
software environment comprising computer system. 

In view of the foregoing computer system description 
and in accordance with one aspect of the invention, the 
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reader is referred to Figure 2. There, an exemplary 
computer system or host system can be seen to comprise part 
of a network, which includes a database host, a network and 
a user. In the context of this document, the term "database 
5 host" will be understood to include a secure portal hosting 
the computer program that embodies the current invention, a 
network server controlled by the server logic (software) 
and a database for storing site content and input data. 
The network. Similarly, the term "user" as used in this 

10 document will be understood to include a patient, event 
user, a physician or safety monitor. 

The present invention can be implemented with a 
software program executable on computer system. Such 
program would typically be stored in memory. A plurality of 

15 dictionaries and thesauri are defined in host computer 

database. Such dictionary and thesauri are stored within a 
database that is preferably stored within a storage device, 
such as data storage device. The user interface, as 
described below includes a plurality of pull down menus. 

20 Each pull down menu contains a list of popular terms used 
to describe a symptom, medication or indication. The terms 
contained in the pull down menus are stored in a dictionary 
and/or thesaurus and are written to the interface display 
by the software of the present invention. Each of the 
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popular terms on the user interface is hard coded to a 
corresponding standardized term. The thesaurus contains 
information associated with each data entry field of the 
user interface. Each pull down menu or data entry field 
5 that is incorporated into the GUI will be associated with a 
particular data field in the thesauri. Each data field in 
the thesauri, corresponding to a user data entry field is 
also associated with a particular standardized term or code 
from a standard medical dictionary, such as MedDRA, ICD-9, 

10 or WHOART. A data entry contained on the pull down menus 
is hard coded to at least one field in the thesauri 
containing a standardized term for that selection. The 
standardized term, such as from MedDRA, is in turn 
populated into the database for a particular reported 

15 event. In that way it is possible to ensure that the 
appropriate term is encoded for all entered data. The 
reported information can include any type of information 
that is useful in implementing the present invention. 
Exemplary information includes the user's ID and password, 

20 the users reporting status, for example patient, family 

member, or treating physician, patient information such as 
age, height and weight, prescribed medication, and 
categorizations, characterizations and descriptions of an 
Adverse Event or Product Complaint. Additionally, 
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particular information regarding the Adverse Event can be 
included. Exemplary Adverse Event information can include 
such things as Body Region; Head: Sub Region; Eyes: 
Symptom; Blurred Vision: Preferred Term; Vision blurred, 
5 and various other information as well. 

Adverse Event or Product Complaint information is 
transmitted from a user to a host computer. The Adverse 
Event or Product Complaint information pertains to at least 
one event or complaint experienced by the customer. The 

10 Adverse Event or Product Complaint information can be 

introduced into system in any suitable way. In a preferred 
embodiment, such information from a user is received 
electronically, via a suitable data link with host 
computer, using one or more of the Internet protocols 

15 mentioned above. Other methods and systems can, of course, 
be utilized to permit such information to be received by 
host computer . 

In a preferred implementation, the information that is 
received into the host computer for each patient pertains 

20 to a plurality of different Adverse Events, Product 
Complaints, medications and symptoms. 

The interface of the present invention is described as 
being presented to the user through the graphical user 
interface of an Internet browser program. The browser's 
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graphical user interface (e.g., Netscape Navigator ) 
presents content provided by a resource (e.g., a file) at a 
URL (Universal Resource Locator) . The content can include 
graphics, text, animation, sound, instructions, etc. A URL 
5 can refer to a location on a remote computer that stores 
the content as data and presentation instruction. The 
presentation instructions and data can be in a variety of 
formats such as HTML (Hypertext Markup Language) , XML 
(Extensible Markup Language) , PDF (Portable Document 

10 Format) , JPEG (Joint Photographic Experts Group) , and MPEG 
(Moving Picture Experts Group) . When browser requests 
content from a URL resource, a remote computer providing 
the resource can transmit the content to a browser for 
presentation. As shown, the browser is an independent 

15 application, however, other applications (e.g., an e-mail 
program, a work processor, or a spread-sheet) can 
incorporate functions traditionally performed by the 
browser. 

II. User Interface 

20 The Graphical User Interface guides the user through 

the application through a standardized flow. In the 
present invention, the user interface is designed so that 
once the user inputs required information, successive step 
are presented automatically. Furthermore, structuring and 
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standardization of input information are achieved by 
providing the user with pull down menus for data entry. 
Free form data entry fields are provided as a backup for 
the pull down menus. While the interface of the present 
5 invention is described as displayed in a web browser 
window, this description is exemplary of one preferred 
embodiment of the present invention, those skilled in the 
art will recognize that many other embodiments with other 
types of interface elements may be used to provide the same 
Q 10 or similar functionality as web browser window. 
CP Figures 3-16 illustrate the data collection and 

*U reporting aspects in one embodiment of the present 

'% invention. One skilled in the art would appreciate that 

q. these various web pages as well as the data fields and 

15 links displayed on each page can be omitted, amended, 
-S3 rearranged or adapted in various ways . Furthermore each 

page may contain cross-referenced links to other pages 
within the site. In that way the user can directly access 
a particular page as needed. 
20 Turning now to Figure 3, there is shown a flow chart 

depicting an exemplary site flow diagram for the present 
invention. The user upon accessing the site is presented 
with an index of the site. This includes; the Patient 
reporting path, the Physician reporting path and the 
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Monitor reporting path. The index page also contains a 
link to the registration page for first time users. The 
user is first presented with a page displaying a site 
index. The site index page displays information regarding 

5 the various reporting section of the interface along with a 
text, representing a link to each section of the site 
embodying the present invention This example Web page was 
sent from the server system to the client system. This 
example Web page contains a free form field for entry of 

10 users UserlD and Password as well as fields to change a 
users password. In addition there is a link to the 
registration page for first time users to input 
registration information. On the Instructions Page, there 
is included a step-by-step instruction for reporting 

15 either; a Side Effect or Adverse Event, or a Product 

Complaint. The user is directed from the login screen to 
the patient path, the physician path or the monitor path. 

Within the patient path the user is presented with a 
login screen, a physician patient consent screen, 

20 instructions for entering the event report, a screen for 
the user to indicate his or her identity and a page to 
initiate either a Adverse Event report or a Product 
Complaint. To report an Adverse Event the user is 
presented with a succession of pages to input information 
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regarding symptoms, medication being taken and herbs and 
nutritional supplements being taken. The user is then 
requested to identify the medication or supplement that is 
suspected of having caused the Adverse Event and the reason 
that the medication or supplement was taken by the patient. 
It would be obvious to one skilled in the art to modify 
these text selections choices to be represented as pictures 
of medications and supplements. If the user is the 
patient, the user is requested to supply information 
regarding the identity of his or her physician. Likewise, 
if the user is a physician, the user is requested to supply 
information regarding the identity of the patient 
experiencing the Adverse Event. 

Upon completion of the data entry, the user is 
presented with a written narrative and a summary report in 
order that the user can confirm the information entered. 
Finally the user is asked to confirm his or her identity. 

The Product Complaint path is similar to the Adverse 
Event path, with the obvious difference being that the user 
reports information regarding a Product Complaint. 

The physician path provides an interface for a 
physician to access reports made by or about a patient. By 
utilizing this feature of the present invention, a 
physician will be able to review reports made by a patient 
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to correct errors or enter additional information. To use 
this feature, a physician will, using a password access a 
list of reports made by or for his or her patients. The 
list will provide links to the full event reports that the 
5 physician can review to either correct or confirm. 

Finally, there is provided a monitor path wherein a 
safety monitor can review all reports for further follow-up 
as needed. The monitor can view a list of reported cases, 
which can be indexed and accessed according to well-known 

10 principles . 

A more detailed view of the interface workflow is 
shown in Figures 3a- 3x. Turning now to Figure 3a, there is 
shown an exemplary Portal Workflow diagram. The user, upon 
accessing the site will be presented with a Getting Stated 

15 page, which has a link to a page presenting patient 

physician relationship information for the user. After 
accessing the Getting Started page, the interface business 
logic directs the user through the registration and login 
process. After the user has completed the registration and 

20 login procedure, the user selects either the Physician, 

Reporter or Monitor path. As can be seen in Figure 3a, the 
Physician and Monitor path can alternately follow either a 
review path, i.e. Physician Confirmation or Monitor, or can 
be redirected to the Reporter path. The user then proceeds 
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to enter identity information and indicate if an Adverse 
Event or Product Complaint will be entered. Turning now to 
Figure 3b, there is shown a workflow diagram for Adverse 
Event and Product Complaint reporting path. The interface 
of the present invention directs the user through the 
selected path to collect information regarding the event 
being reported. Figure 3c depicts the interface workflow 
for the Physician confirmation path. Upon selecting the 
Physician Confirmation path, the physician can select a 
particular patients report from a list and then review and 
or change data on that report. Additionally, the physician 
can select, review and verify lab test result information 
entered by the reporter. Upon completing his review, the 
physician can confirm the data and submit the data along 
with an electronic signature. The physician can then 
review additional patient reports or end his session. 
Turning now to Figure 3d, there is shown an exemplary 
workflow diagram for the Monitor path. Upon accessing the 
Monitor path, the user can review a list of cases and 
select from that list. The user can then; search the 
reported cases for particular data, view and edit 
previously entered data, input new data and produce case 
reports . 

Turning now to Figure 3e, there is shown a detailed 
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view of the side effect reporting workflow of the Adverse 
Event reporting path. The user is directed through the side 
effect reporting path to provide information regarding the 
particular body region, sub region, symptom, duration and 
5 outcome of at least one side effect. 

Turning now to Figure 3f, there is shown a detailed 
view of the Current Medication reporting workflow of the 
Adverse Event reporting path. As shown, the user is 
directed to provided information regarding current 

10 medications, including dosage, formulation, and duration 

and pharmacy information. Upon completion, the user is can 
add the medication to a Medicine Cabinet for inclusion in 
the final report and proceed to Herb and Nutritional 
reporting or delete the information. In Figure 3g, there 

15 is shown a detailed view of the Herb and Nutritional 

Reporting workflow of the Adverse Event reporting path. 
The workflow of this portion of the interface is similar to 
the Current Medication workflow, however is used to supply 
information regarding herbs and nutritional supplements 

20 rather than medication. Additionally, upon completion, the 
user must supply information regarding the medication 
suspected of causing the adverse event, and the reason for 
taking the suspect medication. Figure 3h, depicts a 
detailed view of the Reasons for Medication workflow of the 
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Adverse Event reporting path. The user is directed to 
indicate the medication suspected of causing the Adverse 
Event and the medical condition for which the medication is 
being taken. Finally as shown in Figure 3i, the user must 
5 supply and review additional important information 

regarding his or her primary care physician or treating 
physician, reporter information and lab test information. 

Turning now to Figure 3 j , there is shown a detailed 
view of the Review Information and Find Out More reporting 
fj; 10 workflow of the Adverse Event reporting path. As depicted 
SI in Figure 3 j , the user must review the information 

*y supplied, the auto narrative and the summary report. After 

■^5 comparing the report with pre -prepared statistics, the user 

can enter additional Adverse Event Reports or Product 
y, 15 Complaints. 

p Turning now to Figure 3i, there is shown a detailed 

view of the Product Complaint Workflow. The user is first 
directed to provide information regarding the product in 
question such as medication dosage and formulation. 
20 Additionally, the user is asked to indicate if there is an 
Adverse Event associated with the Product Complaint. The 
user can be prompted to enter the Adverse Event data as 
well as the Product Complaint. If there is no associated 
Adverse Event, the user is directed to indicate the product 
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complaint. Product Complaints can be in several 
categories, for example "Did Not Work" ; "Did Not Like", 
i.e. "Color" ; "Something Wrong" , i.e. "Package Damaged" and 
other such information. As in the Adverse Event reporting 
5 path, the user must also supply identity information and 
review and confirm the data supplied. 

Turning to Figure 4 there is shown an exemplary 
version of a "Registration" page. The Registration page 
displays free form data entry fields for collecting 

10 identity information from a first time user. Those fields 
include in an exemplary version; First Name, Last Name, 
User ID, Password, Password again, and an additional 
security devise such as a Secret Question, Secret Answer (a 
question and answer preselected by the user in order to 

15 provide a means to confirm the users identity) , phone 
number and E-mail address. Also included on the 
registration page will be a statement informing the user 
that their consent is needed to contact the users physician 
to gather additional information to complete the report. 

20 The user is required to provide this consent by clicking an 
Accept button before proceeding with the form. A menu of 
"Getting Started" steps for a first time or previously 
registered user is also provided comprising links to the 
different pages within the site that the user can select to 
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proceed to the desired login or registration step. 

Previously registered users will be directed to a 
login screen. Figure 5 illustrates the display of a Web 
page depicting an exemplary version of a user login page 
5 for the interface of the current invention. As depicted on 
the flow chart once the login is complete, the user can 
select the patient, physician or monitor reporting path. 

To begin the reporting process the user is first 
directed to a page as depicted in Figure 6 which informs 
O 10 the user that both patient and physician identification 
00 information is required to adequately complete the 

reporting process. The user is reminded to include such 
information on the registration page. The user can then 
f*i begin reporting an Adverse Event or Product Complaint or 

15 complete a report that was previously started by clicking 
O the appropriate button provided. 

Upon starting a new event report or restarting a 
report that was started at a previous time the user is 
presented with an Instructions page. Figure 7 illustrates 
20 the display of an exemplary Instructions page for the 
interface of the present invention. The instructions 
indicate to the user the steps needed to report in this 
embodiment either a Side Effect or Adverse Event, or a 
Product Complaint, although the instruction page could 
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include additional information helpful to the user. 

Figure 8 is a exemplary depiction of a data input page 
where the user can select a link or input data by a free 
form data field or a pull down menu with respect to the his 
or her identity. The page includes links for Patient 
Caretaker, Family Member/Spouse , Patient, Pharmaceutical 
Representative, Treating Physician or Other Healthcare 
Professional. In addition, there is provided a data entry 
field for users to enter identity information that is not 
one of the available categories. Upon selecting one of the 
links or pull down menu options the user is then directed 
to the appropriate page for event reporting. In that way 
the user is directed to the data intake page that is most 
appropriate to his or her role with respect to the event to 
be reported . 

Turning now to Figure 9, there is depicted an 
exemplary version of a page wherein the user can designate 
if the report being made is an Adverse Event or a Product 
Complaint. After selection of either a Product Complaint 
or Adverse Event report, additional fields will be 
presented to the user, wherein additional information such 
as Age, Height, Weight, Gender and Pregnancy are entered. 
After entering this data, the user is presented with the 
appropriate reporting page for either Adverse Events or 
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Product Complaints . 

Figure 10a depicts an exemplary version of an Adverse 
Events reporting page. On the Adverse Events reporting 
page the user has several fields in which to input Adverse 
5 Event information. Included in the data that the user must 
input are the Adverse Event symptoms. The symptoms list 
contains popular names for events that a patient would use 
to describe their condition. The user can scroll through 
the list to select the symptom or symptoms that most 
O 10 accurately depict the Adverse Event. In addition, there is 
yy provided a diagram depicting a human body. The diagram is 

divided into regions that represent links for displaying 
j* symptoms for each region of the body. For example, one can 

O select the shoulder and arm region link on the body 

m 

15 diagram. After selecting a particular region, a sub region 

"0 '-}. 

Q list will be presented to the user, as shown on Figure 10a, 

where the user can more specifically delineate the region 
of concern. For example the user can designate the right, 
left or both sides of a selected region. Upon designating a 
20 body sub region there will then be displayed symptoms, 

which are pertinent to that body sub region that the user 
can select by clicking as shown on Figure 10b. The 
symptoms are listed using popular names for each symptom. 
Each popular symptom description is linked or hard coded to 
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the standardized medical dictionary term and code for that 
symptom. As shown on Figure 10c, the user is asked to 
indicate the duration of any symptoms by inputting the date 
that any symptom started, the date that a symptom ended and 
5 further indicate if the symptom is ongoing. The user must 
also enter information regarding the end result of the 
Adverse Event such as hospitalization or death of the 
patient. Finally, the user is asked to provide information 
regarding what action was taken in response to the Adverse 

10 Event. The user is presented with several choices that can 
be checked to indicate a particular action, such as Did 
Nothing, Consulted a Physician, Stopped Medication, Reduced 
Dose or Switched Medication. With respect to the Reduced 
Dose or Switched Medication data input choices, the 

15 interface provides the user with free form data entry 
fields for providing the necessary information. 
Furthermore the user is provided with a check box to affirm 
if the actions helped, a check box to indicate if the 
effect returned when medication was resumed, if another 

20 medication was taken against the Adverse Effect and a check 
box to indicate if the additional medication was effective. 
Finally there is provided a free form data entry field to 
indicate any alternate remedies that the patient pursued. 
Of course this data entry selections and graphical diagrams 
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can be modified to customize the interface for use in a 
particular application. One such modification is depicted 
in Figure lOd. Figure lOd shows an exemplary adverse 
events reporting page displayed using the German language. 
5 The interface of the current invention can be modified to 
display all text in any language. Furthermore, the 
interface can be modified to display pharmaceuticals and 
products available in a particular market. In addition to 
changing the language, the interface can be further 
Q 10 modified to reflect local differences in pharmaceutical 
■U3 products, description of symptoms, and other differences. 

Therefore, Figure lOd is meant to exemplary only, one 
'% skilled in the art could see that it would be possible to 
m incorporate a change in the language of the interface, as 

U 15 well as other modifications while maintaining the 
O functionality of the invention. 

Turning now to Figure 11, there is depicted a data 
entry page for the user to enter information regarding the 
medications that the patient is taking. There is provided 
20 an index of medication names that the user can click on in 
order to select the medication that they are taking. 
Alternately the user can select the medication from a pull 
down menu or enter the medication name in a free form data 
entry field. The medication list in comprised of all 
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commercially available medications. In addition, each 
listed medication can include a graphic depiction of the 
medication, in order to assist the user in selecting the 
correct medication from the pull down menu. The user must 
5 also provide the dosage and formulation information by 
selecting from a pull down menu. 

After the user has selected the medication, dosage and 
formulation information and provided the information 
regarding length of usage time and optional information the 

10 selection is recorded and displayed in a data field on the 
page known as Your Medicine Cabinet by the user clicking on 
a button to add the medication to the list of medications. 
Once the user has entered a first medication into the 
Medicine Cabinet, he or she can repeat the process to add 

15 another medicine, delete a medicine from the list by 

selecting and clicking on the delete button or indicate 
that he is finished entering medications to the list by 
selecting the Done button. Additionally in Figure 12 there 
is shown an exemplary web page where a user must select the 

20 medication or medications, which are suspected of causing 
an Adverse Event. Displayed on the page is a list of the 
medications that the user has previously indicated are 
being taken. Each medication listed is listed together 
with a check box. The user is prompted to enter a check in 
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the box of for each medication that is believed to have 
caused an Adverse Event . Once the user has indicated which 
medication is suspected of having caused an Adverse Event, 
additional information is requested from the user regarding 
5 the medical condition of the patient with respect to the 
use of the medication. In that way it is possible to 
include in the database information regarding what is known 
as "off -label" use of a medication, i.e. use of a 
medication for a non-indicated condition. 

10 Similarly as depicted in Figure 13 there is provided a 

data entry page having the same data fields and as that 
depicted in Figure 11, however it is intended for the user 
to provide data related to herbs or nutritional supplements 
that the patient may also be taking in addition to any 

15 prescribed medication. This information is important in 
evaluating the Adverse Event, as there may be a 
contraindication between a medication and a nutritional 
event . 

Turning to Figure 14 there is shown a web page where a 
20 user can indicate the medical condition for which a 

medication has been prescribed. The medications that the 
patient is taking may have been previously indicated as the 
suspected source of the Adverse Event are listed on the 
page; the user can then select from a pull down menu the 
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medical condition for which the medication is prescribed. 
The pull down menu lists only the on-label uses for each 
medication. If the condition is not listed on the pull 
down menu, then the user can enter the condition via a free 
5 form data entry field. As described hereinafter, when a 
condition is entered in the data entry field, the entry is 
flagged in the database for further review by a safety 
monitor. After the user enters the information indicating 
the disease for which the medication is prescribed, they 

10 are then directed to either the patient or physician 

information page. If the user is the patient, then the 
patient information would have already been entered and the 
user will be directed to the physician information page, 
conversely if the user is the physician, then the physician 

15 information would have already been entered and the user 
will be directed to the patient information page. 

In the same way that the information is gather 
regarding Adverse Event symptoms and medication, the 
interface of the present invention could be modified to 

20 further include web pages to collect information regarding 
any diagnostic tests performed on the patient with respect 
to the Adverse Event. This could include laboratory tests. 
Figure 14A depicts an exemplary page for reporting the 
results of Laboratory test results associated with the 
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report of an adverse event or product complaint . Of course 
the method of the present invention is not limited to 
collecting information regarding any particular diagnostic 
test and could be modified to accommodate a particular 
5 circumstance . 

Turning now to Figure 15, there is depicted a page 
displaying a verbatim narrative that is compiled from the 
information provided by the user. The narrative is 
generated by the narrative engine that is part of the 

10 software embodying the present invention. The narrative 
engine uses the response that the user has input and 
formulates a highly structured and standardized narrative 
of the Adverse Event. The narrative engine employs 
programming logic that would be well known to one skilled 

15 in the art. The narrative provides an additional means of 
quality control for the event report by reiterating the 
users input in a standardized, structured, clear and 
concise manner. The user is given an opportunity to review 
all of the information provided in the form of a written 

20 narrative and add or correct any information. 

After reviewing the narrative report, the user is 
given a final opportunity to verify the information 
provided. Figure 16 depicts a page displaying a summary 
report of all information previously entered. The 
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information includes Patient Inf ormation, Adverse Event 
information, Suspected Medications and Concomitant 
Medication. The user is instruction to type over text to 
edit any information appearing in the summary and then 
5 indicate that the report is complete by clicking on a 

button provided. Finally the user is presented with a page 
displaying data fields for entering identification 
information for the user. Information such as user name, 
address, telephone number, date of birth and occupation are 
p 10 typically included. 

§J In accordance with the description of the above 

*fj information gathering pages of the interface of the present 

"2 invention, there is also provided within the patient 

q reporting process a path to report Product Complaints. 

h& 15 While the information gathered will not be exactly the same 

O as that collected for an Adverse Event, modifications to 

the interface and database of the present invention will be 
obvious to one skilled in the art. Likewise the interface 
also provides a physician path and a monitor path. These 
20 paths differ from the patient path in that the main 

function of each is to provide information to a safety 
monitor or a patient's physician. Therefore the interface 
is adapted to report information that has been previously 
entered in the physician and monitor path. 
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III. Database Terminology Standardization 

The Adverse Event and Product Complaints that are 
furnished by the user are input using common popular terms 
5 for each symptom in accordance with the vernacular language 
of a particular country or culture. It is however, 
necessary to describe all symptoms in standardized terms in 
the final report the pharmaceutical company uses in 
assessing an event. For example, symptoms can be described 

10 using MedDRA terminology to ensure that like events are 

described in like manner. However, due to the large number 
of terms in standardized dictionaries such as MedDRA, it is 
difficult to efficiently encode the description of an 
Adverse Event or Product Complaint. 

15 The standardized terms that are presented to the user 

are compiled in such a way so as to correspond to everyday 
common terminology used to describe symptoms. Thus rather 
than utilizing a symptom list derived from a standardized 
industry dictionary such as MedDRA, the symptom list is 

20 compiled by first generating a list of commonly used terms 
to describe a symptom. Those terms are then hard coded to 
correspond to a single particular standardized symptom 
term. In this way, the user of the present invention is 
presented with an interface that is easier to use and thus 
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results in more reliable reporting by the user. 
IV. Database 

Turning now to the database component of the present 
5 invention, there is provided a database with a software 

component for managing and storing data that is transmitted 
from a user to the host computer embodying the present 
invention. Utilizing the Internet to collect and manage 
data allows an enterprise to quickly and efficiently 
10 connect to many and distant remote users, however, a number 
of problems occur when using a Internet base data 
management system which are not addressed by the current 
systems . 

A data management system utilizing Internet-based 
15 communication is different from mainframe and client-server 
arenas traditionally used for data management. One 
difference is that HTTP, an underlying protocol of internet 
communication, is both connectionless and stateless. 

The Internet is said to be stateless because no 
20 information about what occurred previously is maintained. 
Most modern applications maintain state, which means that 
they remember what you were doing last time you ran the 
application, and they remember all your configuration 
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settings. This is extremely useful because it means you can 
mold the application to your working habits. 

The World Wide Web, on the other hand, is 
intrinsically stateless because each request for a new Web 
5 page is processed without any knowledge of previous pages 
requested. This is one of the chief drawbacks to the 
Internet and the HTTP protocol . Because maintaining state 
is extremely useful, programmers have developed a number of 
techniques to add state to the World Wide Web. These 
10 include server APIs, such as NSAPI and ISAPI, and the use 
of cookies. 

The stateless condition of the Internet causes a 
problem for dynamic interactions where a web system needs 
to be able to keep track of the user's state during a 

15 session involving multiple web interactions (e.g., web page 
requests) . Without a way to manage state, between web 
transactions the system will have "forgotten" information 
about the user and the context of the session. This can be 
further complicated by the fact that in many large web 

20 systems the user does not interact with the same web server 
during a session . 

The stateless condition is especially a problem when 
using the Internet for collecting data. When collecting 
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complex data using an Internet based application, it is 
usually necessary to have multiple web pages within a site 
for identifying and registering a user, collecting data and 
confirming user input. This is a problem in a stateless 
5 environment, because information entered identifying the 
user or data collected on one page is lost when the user 
directs his browser to another page, unless that 
information is saved directly to a database or cookies are 
used. Saving information directly to a database as soon as 

10 it is entered is an inefficient process and can result in 
incorrect data being included in the database. 

The present invention overcomes the traditional 
problems of using a stateless environment for data 
management by utilizing a software data management tool for 

15 receiving, managing and storing data. 

All data collected from the user in the current 
invention is stored in a database that includes the user 
and patient identity information as well as the incident 
report . The database makes use of an XML encoding because 
20 of its capability to create large repositories of data that 
operate across any computer platform. For example one can 
map the fields of a database to elements, and then share 
that information across a vast array of platforms. The XML 
database structure is hosted on the server side and then 
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the XML is completely decomposed into HTML interface 
components (form elements) at the application server and 
sent as HTML to the client where it is rendered. 

The XML data structure provides an extremely flexible 
architecture for structured information collection, 
manipulation and storage. The interface portal of the 
present invention implements a data collection mechanism, 
which moves users from page to page, enforcing business 
logic (such as ensuring that required fields have content) 
and populating that data to an XML structure. As each page 
is completed, the XML structure is serialized and moved to 
the next page where it is deserialized and the next page's 
content is loaded into the structure. When a person has 
completed the required information, the XML structure is 
deserialized, each data field is inspected to ensure that 
the data conforms to specified constraints, and the 
information is entered into the system. The entire 
populated XML structure is also stored in the database and 
used to quickly populate screens when monitors or other 
medical personnel request the file. 

The flexibility provided by using XML to manage the 
data allows the Portal and collected data to be highly 
modifiable. While data is deserialized and stored 
discreetly in the database, that data is really only used 
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for quick searches. The actual work is performed through 
the passing, storage, and manipulation of the XML 
structure . 

Furthermore, in another embodiment, it would be 
possible to implement the present invention by utilizing 
signing certificates. It would be possible to actually send 
a user the XML structure so they can sign it. The signed 
objects could then be stored in the back end for non- 
repudiation . 

Turning to Figure 17, there is depicted a block 
diagram representing components of the system of the 
current invention for the transfer and storage of data. 
The system is depicting as including a user interface, a 
software package, commonly referred to as "middleware" that 
controls the flow of data between the user and the host, 
including logic and data checking. In addition there is 
provided a thesauri database, a user database, and an event 
report database . 

There is shown in Figure 17 an exemplary interface 
screen, the interface software and logic, and a plurality 
of database storage media. The interface includes a 
plurality of data entry categories such as symptom, 
medication-dosage, and medication- indication. A user enters 
data using the interface through a plurality of pull down 
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menus or free form data entry fields. It is preferable 
that the user enter all data by selecting an entry from the 
provided pull down menus, therefore it is a feature of the 
present invention to include a full range of pull down 
5 menus to cover a majority of the possible data entries for 
each category. In that way it is possible to reduce input 
errors by providing the user with a list of the most common 
data entries. Therefore a user will only need to enter 
data without the aid of a pull down menu in exceptional 

10 circumstances. 

The interface software displays the information to the 
user through the interface of the present invention in the 
exemplary version described herein. A web page text file 
incorporating a set of HTML tags describes how the text 

15 should be formatted when a browser displays it on the 

screen. The tags are simple instructions that tell the Web 
browser how the page should look when it is displayed. A 
Web browser, like Netscape Navigator™ or Microsoft Internet 
Explorer™, requests a page, so that the browser can pull 

20 the page through the network and into the users machine and 
interprets the set of HTML tags within the page in order to 
display the page on the users screen. Additionally, the 
interface software includes logic, which controls the flow 
of data to and from the user interface. The interface 
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logic includes a dynamic XML component that reads data 
entry choices from the database, displays those choices on 
the interface and records the users selections on a dynamic 
web page. Once the user has confirmed the selections the 
dynamic XML component parses the data to a storage 
database. The process can be described with respect to the 
Figure 18. In step 1, the user accesses a web page of the 
current invention, wherein the dynamic XML component refers 
to the thesauri database . The XML component reads the 
appropriate common language term to be displayed in each 
pull down menu field of the accessed web page. Each common 
language term is linked to the appropriate medical 
dictionary term and code in a corresponding thesaurus of 
the database. In step 2 a user selects a data entry term 
from the plurality of data terms listed in a particular 
pull down menu. The dynamic XML component, in response to 
the selection made by the user, reads the user selection, 
from the interface and writes that data into a dynamic XML 
page together with the corresponding term and code from the 
linked thesauri. The dynamic web page is established by 
the dynamic XML component for each event report initiated 
by a user, and is provided to temporarily maintain the data 
until the user has completed all data entry. In that way 
any changes or edits can be easily made prior to writing 
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the data to the storage medium of the database. By 
utilizing the dynamic XML component all logic can be 
contained in the dynamic XML component, and the database 
can be a simple storage device. Therefore, any changes 
5 with respect to how the data is saved can be implemented in 
the XML component without the need to change or amend the 
database. In alternate step 2 the user may provide a 
response to an information request by manually entering the 
data in a free form data field. In the exemplary version 

10 described here as a web based user interface, the user 

would position the cursor into a free form data field and 
type the data entry. The XML component then reads the data 
entered and writes the response to the dynamic XML page. 
The XML component also flags certain response for further 

15 review by a safety monitor. Those responses include; 

manually entered responses, and responses which indicate 
that the reported event may be potentially serious and/or 
non-labeled. The seriousness of an event is determined by 
automatically assessment of the selected outcomes vs. a 

20 standard list of "serious" outcomes as defined by the 
regulatory bodies. The "labeled-ness" of the event is 
automatically determined by comparing the selected symptoms 
with a pre-defined list of MedDRA or other schema of 
preferred terms, characterized by the manufacturer as 
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"labeled" or "potentially labeled" . In that way an 
additional quality control check is added for data that is 
manually entered by the user that may be prone to errors, 
inconsistencies and/or inaccuracies. Steps 2 and alternate 
5 step 2 are repeated by the user until all data has been 
entered. The XML component will write each data entry to 
the dynamic XML page. In step 3 the user is presented with 
a web page that displays all data entered with respect to 
the event being reported. The user can then confirm or 

10 edit the displayed responses and then enter a final 

confirmation by clicking a provided button. After the user 
issues a final confirmation, the XML component will then 
parse the data, step 4, held on the XML page into the 
appropriate data fields in the database where the data is 

15 permanently stored. 

The data is permanently stored using a database 
server. The database server is an application program that 
interacts with a database. Generally, the functions of the 
database server are to receive requests for information 

20 directed to the database, format the requests into queries 
that are understood by the database, submit the requests to 
the database, receive one or more results from the 
database, format the results, and deliver the formatted 
results to one or more other application programs. For 
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example, the database server may receive a request for 
information in the database in the form of a Structured 
Query Language (SQL) statement that identifies one or more 
tables in the database. The database server verifies that 
the SQL statement has correct syntax and identifies 
information that is actually in the database. The database 
server submits the SQL statement to the database and 
receives a result set of records from one or more database 
tables . 

The browsing engine is an application program that 
interacts with the other application programs to carry out 
a method of browsing a hypertext system in the manner 
described further herein. Generally, the browsing engine 
establishes one or more connections with one or more 
clients, presents a view of hypertext documents in the 
database to the clients, receives information that 
identifies which documents in the database are relevant to 
the clients, creates a ranked list of the documents based 
upon the relevance information, and provides the ranked 
list to the clients. Other functions of the browsing engine 
are apparent from the description herein. 

V. Embodiments 

In an alternate embodiment, the present invention can 
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be utilized to automate the process of collecting data 
having significance to a particular group of users. For 
example, the present invention could be used to report 
problems with consumer goods, such as automobiles. 
5 Complaints and problems with new automobiles are monitored 
by the manufacturer for quality control, by consumer groups 
to gauge value, and by the federal government for recall 
purposes. In an alternate embodiment of the present 
invention, certain aspects would be adapted to the 

10 alternate use. For example, the interface and database of 
the current invention could be adapted for use in receiving 
reports on automobile defects and problems. 

With respect to the user interface, the user would be 
presented with pages containing images and information 

15 consistent with the purpose of the site. For example the 
network site embodying the present invention could include 
a consumer path a manufacturer path and a monitor path. 
The site could provide a means for a consumer to easily and 
efficiently report problems regarding a vehicle to the 

20 manufacturer. In this alternate embodiment, a consumer 
path would replace the patient path. Figure 10a, b,c would 
alternately depict a diagram of a generic vehicle, which 
the user would be able to click on to select various 
systems and sub- systems. As in the current embodiment, 
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selecting a system or sub-system, would display to the user 
a plurality of pull down menus containing a list of 
problems associated with that area of the vehicle that the 
user could click on in order to report a problem or 
5 difficulty. It is obvious to one skilled in the art that 
the system embodying the present invention could be further 
modified to accommodate this or other alternate 
embodiments. Other alternate embodiments could include a 
system for reporting problems with consumer goods other 
10 that motor vehicles and health or disease control problems 
with respect to animals. Other uses and modifications to 
the present invention will be obvious to those skilled in 
the art . 

The techniques described here are not limited to any 
15 particular hardware or software configuration; they may 
find applicability in any computing or processing 
environment. For example, functions described as being 
performed by a server can be distributed across different 
platforms. Moreover, the techniques may be implemented in 
20 hardware or software, or a combination of the two. 

Preferably, the techniques are implemented in computer 
programs executing on programmable computers that each 
include a processor, a storage medium readable by the 
processor (including volatile and non-volatile memory 
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and/or storage elements) , at least one input device and one 
or more output devices. Program code is applied to data 
entered using the input device to perform the functions 
described and to generate output information. The output 
5 information is applied to one or more output devices. 

Each program is preferably implemented in a high level 
procedural or object oriented programming language to 
communicate with a computer system, however, the programs 
can be implemented in assembly or machine language, if 

10 desired. In any case, the language may be a compiled or 
interpreted language. 

Each such computer program is preferably stored on a 
storage medium or device (e.g., CD-ROM, hard disk or 
magnetic diskette) that is readable by a general or special 

15 purpose programmable computer for configuring and operating 
the computer when the storage medium or device is read by 
the computer to perform the procedures described in this 
document. The system may also be considered to be 
implemented as a computer-readable storage medium, 

20 configured with a computer program, where the storage 

medium so configured causes a computer to operate in a 

specific and predefined manner. 

Thus, the foregoing descriptions of specific 

embodiments of the present invention have been presented 
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for purposes of illustration and description. They are not 
intended to be exhaustive or to limit the invention to the 
precise forms disclosed, and obviously many modifications 
and variations are possible in light of the above teaching. 
5 The embodiments were chosen and described in order to best 
explain the principles of the invention and its practical 
application, to thereby enable others skilled in the art to 
best utilize the invention and various embodiments with 
various modifications as are suited to the particular use 
10 contemplated. It is intended that the scope of the 

invention be defined by the Claims appended hereto and 
their equivalents. 
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